3 links tagged with all of: rag + retrieval augmented generation
Click any tag below to further narrow down your results
Links
STAIR is a retrieval system that feeds an LLM a book's table of contents so it can store and fetch information from its parameters, rather than chunking text by length. The authors also release SearchTome, a benchmark built from 18 books across six domains.
- Standard retrievers split long documents into fixed-length chunks and discard global structure like the table of contents; STAIR keeps that structure.
- On SearchTome, STAIR reaches 82.6% Recall@1, versus 76.9% for DSI, 68.7% for DPR, and 59.5% for BM25; the authors report the DSI gap as statistically significant.
- The authors claim a hallucination rate under 0.05% for the generative retrieval setup and say it generalizes to cases with very few training samples.
+ stair
+ searchtome
+ differentiable search index
retrieval augmented generation
+ document retrieval
rag
This is an AWS Marketplace tutorial for a retrieval-augmented generation setup: documents land in S3, a Lambda function chunks them and writes embeddings (via Amazon Titan on Bedrock) into an Elastic vector index, and API Gateway exposes a chat agent over that data. It ships as a Terraform module that automates the whole pipeline.
- The pipeline is fully event-driven: an S3 upload triggers a containerized Lambda that loads, splits, embeds, and stores the documents in Elastic with no separate ETL infrastructure.
- Elastic is positioned as one store for both full-text and vector search, connected privately to AWS via PrivateLink, with a free trial and a Quick Launch deployment.
- Amazon Titan models on Bedrock handle the embeddings and answer generation, with API Gateway providing the user-facing endpoint.
Organizations are increasingly faced with the decision of whether to implement Retrieval-Augmented Generation (RAG) or fine-tuning for their AI initiatives. RAG connects large language models to external databases, allowing access to real-time information, reducing inaccuracies, and enhancing security and traceability. However, implementing RAG comes with its own technical challenges that require careful planning and maintenance.
- RAG connects LLMs to external data sources so responses reflect real-time information rather than static training data
- Grounding responses in retrieved data cuts down on hallucinations and improves accuracy
- RAG offers added benefits like source traceability and better security for proprietary data
- Setting up RAG requires substantial infrastructure work—data pipelines, indexing, and ongoing maintenance for quality and scalability